**** ASA Chart Generator ****
Author: Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, Willem-Paul Brinkman
Corresponding author: Siska Fitrianie, s.fitrianie@tudelft.nl

Interactive Intelligence Group
Department of Intelligent Systems
P.O. Box 5031,
2600 GA Delft,
The Netherlands

To cite:
Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. The Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions. In ACM International Conference on Intelligent Virtual Agents (IVA’22), September, 2022, Faro, Portugal. ACM, New York, NY, USA. https://doi.org/10.1145/3514197.3549612

Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. Artificial Social Agent Questionnaire Instrument. https://doi.org/10.4121/19650846 4TU.ResearchData. 

Description of the dataset
------------------------------------------------------------------------------------------------------------------------------------
The ASA Chart Generator is one of the output of the research into Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. The Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions. In ACM International Conference on Intelligent Virtual Agents (IVA’22), September, 2022, Faro, Portugal. ACM, New York, NY, USA. https://doi.org/10.1145/3514197.3549612


The ASA Chart is an informative visual tool to display the scores of an artificial social agent (ASA) on the 24 constructs/dimensions on a two-dimensional plane, resulted from multi-year efforts involving more than 100 Intelligent Virtual Agent (IVA) researchers worldwide within the OSF work-group of Artificial Social Agent Evaluation Instrument (https://osf.io/6duf7/). The scores are normalised to a 7-point scale with an interval between -3 to 3 and 0 as the middle point. Each score of a construct/dimension is depicted on an axis that emerges from a common central point. We arranged the constructs/dimensions of the ASA Questionnaire on the ASA chart based on their distance in the factor analyses and theoretical similarities. The total score (rounded up), of all the constructs/dimensions is displayed in the middle of the chart which is called the ASA-score. The chart allows us for easy comparison between different ASAs: the ASA chart shows the profile of an ASA with regards to users' view about the ASA and their interaction.


Abstract of the article Fitrianie et al. (2022)
------------------------------------------------------------------------------------------------------------------------------------
We present the ASA Questionnaire, an instrument for evaluating human interaction with an artificial social agent (ASA), resulted from multi-year efforts involving more than 100 Intelligent Virtual Agent (IVA) researchers worldwide. It has 19 measurement constructs constituted by 90 items, which capture more than 80% of the constructs identified in empirical studies published in the IVA conference 2013-2018.  This paper reports on construct validity analysis, specifically convergent and discriminant validity of initial 131 instrument items that involved 532 crowd-workers who were asked to rate human interaction with 14 different ASAs. The analysis included several factor analysis models, and resulted in the selection of 90 items for inclusion of the long version of the ASA questionnaire. In addition, a representative item of each construct or dimension was select to create a 24-item short version of the ASA questionnaire. Whereas the long version is suitable for a comprehensive evaluation of human-ASA interaction, the short version allows quick analysis and description of the interaction with the ASA. To support reporting ASA questionnaire results, we also put forward a ASA chart. The chart provides a quick overview of agent profile.

Requirements
------------------------------------------------------------------------------------------------------------------------------------
1. Internet Browser
2. Pdf reader


Quick Instruction
------------------------------------------------------------------------------------------------------------------------------------
1. Use asachart_singleASA.html for generating an ASA chart for a single ASA
2. Use asachart_2ASAs.html for generating an ASA chart for comparing two different ASAs
3. Fill in the short version of ASA Questionnaire (if available) OR 
4. Input 24 scores that are representing the 24 constructs/dimensions in the ASA Questionnaire (decimal is possible). 14_ASAs_input.pdf provides examples of input based on 14 ASAs used in the research. 


Construct/Dimension Numbering Reference:
------------------------------------------------------------------------------------------------------------------------------------
C01D01: Human-Like Appearance
C01D02: Human-Like Behavior
C01D03: Natural Appearance
C01D04: Natural Behavior
C01D05: Agent’s Appearance Suitability
C02: Agent’s Usability
C03: Performance
C04: Agent’s Likability
C05: Agent's Sociability
C06D01: Agent's Personality Presence
C07: User Acceptance of the Agent
C08: Agent's Enjoyability
C09: User's Engagement
C10: User's Trust
C11: User-Agent Alliance
C12: Agent's Attentiveness
C13: Agent's Coherence
C14: Agent's Intentionality
C15: Attitude
C16: Social Presence
C17: Interaction Impact on Self-Image
C18D01: Agent's Emotional Intelligence Presence
C18D03: User's Emotion Presence
C19:  User-Agent Interplay
